Basis Markov Partitions and Transition Matrices 
for Stochastic Systems 

Erik Bollt 1 , Pawel Gora 2 , Andrzej Ostruszka 3 , and Karol Zyczkowski 3 ' 4 

1 Department of Mathematics & Computer Science and Department 

of Physics, Clarkson University, Potsdam, NY 13699-5805 
2 Department of Mathematics and Statistics, Concordia University 
7141 Sherbrooke Street West, Montreal, Quebec H4B 1R6, Canada 
institute of Physics, Jagiellonian University, ul. Reymonta 4, 30-059 Krakow, Poland 
4 Center for Theoretical Physics, Polish Academy of Sciences, 
Al. Lotnikow 32/44, 02-668 Warszawa, Poland 



(Dated: May 8, 2006) 

We analyze dynamical systems subjected to an additive noise and their determin- 
istic limit. In this work, we will introduce a notion by which a stochastic system 
has something like a Markov partition for deterministic systems. For a chosen class 
of the noise profiles the Frobenius-Perron operator associated to the noisy system is 
exactly represented by a stochastic transition matrix of a finite size K. This feature 
allows us to introduce for these stochastic systems a basis-Markov partition, defined 
herein, irrespectively of whether the deterministic system possesses a Markov par- 
tition or not. We show that in the deterministic limit, corresponding to K — ► do, 
the sequence of invariant measures of the noisy systems tends, in the weak sense, 
to the invariant measure of the deterministic system. Thus by introducing a small 
additive noise one may approximate transition matrices and invariant measures of 
deterministic dynamical systems. 
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I. INTRODUCTION 

Markov partitions for deterministic dynamical systems serve a central role for determining 
their symbolic dynamics, whose grammar is described by a finite sized transition 



matrix that generates a so-called sofic shift 14, 51. The conditions for such a projection were 

nn 

defined by Bowen for Anosov hyperbolic systems jlj, |3(, and stated succinctly for interval 
maps as apartition whose elements are each a homeomorphism onto a finite union of its 
elements 0, [J- We remark here that a defining property in both cases is that the set 
of characteristic functions defined over the elements of the Markov partition project the 
transfer operator exactly onto an operator of finite type; that is a matrix results whereas 
an infinite matrix would be expected for a non-Markov system. We argue here that this 
should be the defining property of any generalization of Markov partitions; that is, a set 
of basis functions which project the Frobenius-Perron operator exactly onto a finite-rank 
matrix with no residual. 

First we recall the Frobenius-Perron operator for a deterministic transformation. Associ- 
ated with a discrete dynamical system acting on initial conditions, z e M (say a manifold, 
M c 3? n ), 

: M - ■ M. 

x ^ F{x), (1) 

is another dynamical system over L l (M), the space of densities of ensembles of initial con- 
ditions. 

P F : L\M) -> L 1 (M), 

p(x) h- P F [p(x)}. (2) 



This Frobenius-Perron operator (Pf) is defined through a continuity equation 

/ p{x)dx = I Pp[p(x)]dx, (3) 
Jf^(b) ' Jb 

for measurable sets B C M. Differentiation changes this operator equation to the commonly 
used form, 

P F [p(x)}= [ 5(x-F(y))p(y)dy, (4) 

J M 

acting on probability density functions p G L 1 (M). 
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Now consider the stochastically perturbed dynamical system 



F v : M 



M, 



x i — ► 



(5) 



where £ is an i.i.d. random variable with PDF z/(z), which is applied once per each iteration. 
The random part v is assumed to be independent of state x which we tacitly assume to be 
relatively small, so that the deterministic part F has primary influence. The "stochastic 
Frobenius- Perron operator" has a similar form to the deterministic case 



where the deterministic kernel, the delta function in Eq. (J2J), now becomes a stochastic kernel 
describing the PDF of the noise perturbation. In the case that the random map Eq. (jSJ) arises 
from the usual continuous Langevin process, the infinitesimal generator of the Frobenius- 
Perron operator (FP-operator) for normal v corresponds to a general solution of a Fokker- 
Planck equation, [6| . The Frobenius-Perron operator formalism is particularly convenient in 
that it allows for an arbitrary noise distribution v to be incorporated in a direct and simple 
way. Within the formalism, we can also study multiplicative noise [x — > r]F(x), modeling 
parametric noise). The kernel-type integral transfer operator is, )C(x,y) = v(x/ F(y))/ F(y) 
for x G 3? + , which can then also be finitely approximated as described in the next section, 
and usefully re-ordered to canonical block reduced form. In more generality, the theory 
of random dynamical systems [j| clearly classifies those random systems which give rise to 
explicit transfer operators with corresponding infinitesimal generators, and there are well 
defined connections between the theories of random dynamical systems and of stochastic 
differential equations. 

The main aim of this work is to investigate a class of stochastically perturbed dynamical 
systems for which the FP operator is represented by a finite stochastic transition matrix 
of size K. Such dynamical systems will be called basis-Markov in analogy to deterministic 
dynamical systems possesing a Markov partition, for which the associated FP operator is 
finite. The deterministic limit of the stochastic system corresponds to the divergence of the 
matrix size. In this limit, K — > oo, the sequence of invariant measures of the stochastic 
systems acting in the i^-dimensional Hilbert space converges, in the weak sense, to the 
invariant measure of the coresponding deterministic system. 




(6) 
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The paper is organized as follows. The Ulam-Galerkin method of approximating the 
infinite dimensional FP operator and the concept of the Markov partition for a deterministic 
system are reviewed in sections II and III, respectively. In section IV we introduce the notion 
of basis-Markov stochastic systems, while in section V we analyze a particular example of 
random systems perturbed by an additive noise with cosine profile. The key result on 
convergence of the invariant measures for stochastic and deterministic systems is proved in 
section VI. A discussion of isospectral matrices used to describe the FP operator is relegated 
to the appendix. 



II. ULAM-GALERKIN'S METHOD- APPROXIMATING THE 
INFINITE-DIMENSIONAL OPERATOR 

A Galerkin's method may be used to approximate the Frobenius-Perron operator by a 
Markov operator of finite rank. Formally, projection of the infinite dimensional linear space 
L l (M) results with discretely indexed basis functions {<fii(x)} c *l 1 C L^iM) onto a finite 



dimensional linear subspace generated by a subset of the basis functions 

Aiv = span({(j)i(x)}f =1 ), (7) 

such that <pi G L 1 (M) Vz. This projection, 

p:L 1 (M)^A Nl (8) 

is realized optimally by the Galerkin method in terms of the inner product, which we choose 
to be integration, 

(f,g)= [ f(x)g(x)dxyf,geL 2 (M). (9) 

J M 

Specifically, the infinite-dimensional "matrix" is approximated by the N x N matrix, 

Aij = (PfM^) = [ PfAM^M^ 1 < hJ < N. (10) 

J M 

One approximates p(x), through a finite linear combination of basis functions, 

N 

(11) 

i=l 

The historically famous Ulam's method [q| for deterministic dynamical systems is equivalent 
to the interpretation to find the fraction of the box E>i which maps to Bj\ the Ulam matrix 
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is equivalent to the Galerkin matrix by using Eq. (|10|) and choosing the basis functions to 
be the family of characteristic functions, 



Specifically, we choose the ordered set of basis functions to be in terms of a nested refinement 
of boxes {Bi} covering M. Though Galerkin's and Ulam's methods are formally equivalent 
in the deterministic case, we are of the opinion that the Galerkin description is a more 
natural description in the stochastic setting. 

III. MARKOV PARTITIONS OF DETERMINISTIC SYSTEMS, AND EXACT 



In this section, we discuss that a Markov partition is special for the Frobenius-Perron 
operator of a deterministic dynamical system, in that characteristic functions supported over 
those partition elements leads to an exact projection of the FP operator onto an operator 
of finite rank - a matrix. 

For a one- dimensional transformation of the interval, a Markov partition is defined 

Definition: A map of the interval / : [a, b] — > [a, b] is Markov if there is a finite partition 
{Ij} such that, 

1. Ujlj = [a,b] (covering property), 

2. int(Ij) fl int(Ik) = if k ^ k (no overlap property), 

3. f(Ij) = Ukilk,, (a grid interval maps completely across a union of intervals without 
"dangling ends" property). 

It is not hard to show that the set of characteristic functions forms a finite basis set of 
functions 



such that Galerkin projection Eq. (fTUj) is exact onto an operator of finite rank, or a matrix 
A it j. That is, Eq. (fTUj) simplifies, 




(12) 



PROJECTION 



{&(*)} = {!*(*)} 



(13) 
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S(x - F(y))<f>i(y)<j>j(x)dydx 

M J M 

= I 6{x- F(y))dydx 1 < i,j < N. (14) 
Jij Jii 

From the definition of the Markov partition, we see that a row of Ay accounts that Pp v \<\)i{x)\ 
is a linear combination of 4>j(x). 

Similarly, there is a well defined notion of an Anosov diffeomorphisms with a Markov 
partition lfll and so for such systems, it can be shown that characteristic functions 
supported over the corresponding Markov partition creates a basis set such that Eq. ([TU]l 
results in an operator of finite rank. 

We take these observations as motivation to make the following definition which is meant 
to generalize the notion of a Markov partition to stochastic systems: 

Definition: Suppose a measure space, {M,B,p}, and a transformation F : M — > M, 
then the transformation is "basis Markov" if there exists a finite set of basis functions 
{<pi(x)}2 = i : M — > [0, 1] G L X (M) such that the Frobenius-Perron operator is operationally 
closed within A n , where A n = span({0j(a;)}" =1 ). That is, for any probability measure p, its 
image Pp[p(x)] belongs to A n . 

Remark 1: If a transformation F is basis-set Markov, then if we perform Galerkin's method, 
Aij = {PF„[4>i\, 4>j)MxM, with that basis set, then it allows that for any initial density which 
can be written as a linear combination of these basis functions, 

n 

Po(x) = ^2c i (f) i (x), (15) 

or stated simply, 

Po(x) e A n , (16) 

then the action of the Frobenius-Perron operator on such initial densities, pi(x) = Pp l/ [po(x)], 
can be exactly represented by the following matrix-vector multiplication: 

■n 

c' — A ■ c, where pi(x) = ^c-0j(a;). (17) 

i=i 

That is, the FP operator projects exactly to an operator of finite rank - a matrix. 

Note that for a general finite set of functions, if we take a general linear combination 
of those functions and then apply the Frobenius-Perron operator, we do not expect the 
resulting density can be written as a (finite) linear combination of basis functions. 
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The following is a direct consequence of our definition of basis Markov in relationship 
to the usual definition of a Markov map, stating the sense in which basis Markov is a 
generalization: 

Remark 2: Given a Markov map, then Eq. (j!4|) implies that any Markov map, together 
with the characteristic functions supported over the partition elements, is basis Markov. 



IV. BASIS MARKOV STOCHASTIC SYSTEMS: A GENERAL CASE DUE TO 

SEPARABLE NOISE 

We analyze a dynamical system defined on an interval M = [0, 1] with both ends identified 
and subjected to a specific form of the additive noise, 

x' = f(x)+£. (18) 

To specify the special case of the stochastic dynamical system written in Eq. ©, the stochas- 
tic perturbation will be characterized by the probability V(x,y) of a transition form point 
x to y induced by noise. Describing the dynamics in terms of a probability density p{x) its 
one-step evolution is governed by the stochastic Frobenius- Perron (FP) operator, 

p'(y)=P f (p(y)) = Jv(f(x),y)p(x)dx. (19) 

We will denote this stochastic Frobenius- Perron operator by the symbol Pf, in all that 
follows. The operator Pf acts on every probability measure defined on M and in general, it 
cannot be represented by a finite matrix. However, in the sequel we shall analyze a certain 
class of noise profiles for which such a representation is possible. 

We assume that the transition probability V(x,y) satisfies the following properties [3, 



13|: 



a) V(x,y) = V(x-y)=V(Z), 

b) V(x,y) ee V{x mod 1, y mod 1), 

N 

c) V{x,y) = A mn u n (x)v m (y), (20) 

m,n=0 

for x, y E K and an arbitrary finite N. Property a) assures that the distribution of the 
random variable £ does not depend on the position x, while the periodicity condition is 
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provided in b). A noise profile fulfilling the latter property c) is called separable (decom- 
posable), and it allows us to represent the dynamics of an arbitrary the system with such a 
noise in a finite dimensional Hilbert space. Here A = (A mn ) m>n=0 ,... J Ar is a yet undetermined 
real matrix of expansion coefficients. Note that A characterizes the noise and does not de- 
pend on the deterministic dynamics /. We assume that the functions u n \ n = 0, . . . , N and 
v m ; m = 0, . . . , N are continuous in X = [0, 1) and linearly independent, so we can express 
/ = 1 as their linear combinations. Both sets of functions span bases in an N + 1 Hilbert 
space. Their orthogonality is not required. 

This name "separable noise" is concocted in an analogy to separable states in quantum 
mechanics and separable probability distributions, since such a property was called iV + In- 
separability by Tucci Q|. Making use of this crucial feature of the noise profile we may 
expand the kernel of the Frobenius-Perron operator ([19)1 . 

p'(y) = P f (p(y)) = / A mn u n (f(x))v m (y)p(x)dx (21) 

^° m,n=0 

N , rl 



Y A mn / u n (f(x))p(x)dx v m (y) (22) 



n=0 

for y G X, where, 



m,n=0 

u n(f(x))p(x)dx v n (y) 







N 



Vn — ^ A mn v m . (23) 

m=0 

Thus, any initial density is projected by the FP-operator Pf into the vector space spanned 
by the functions v m ; m = 0, . . . , N. 

Assuming that a given density p(x) belongs to this space, we can be expand it in this 
basis, 

N 

P( X ) = ^QniVmix) . (24) 

Expanding p' in an analogous way we will describe it by the vector <f = {q' , . . . , q' N }. 
Let B denotes a matrix of integrals, 

B nm = / u n (f(x))v m (x)dx, (25) 

where n,m = 0, . . . , N. Observe that B depends directly on the system / and on the noise 
via the basis functions u and v. Making use of this matrix, the one-step dynamics (J2*3*j) may 



9 



be rewritten in a matrix form 

N 



q' n = ^2 DnrnQm, where D = BA (26) 

m=0 

and A is implied by fl20(l . In this way we have arrived at a representation of the Frobenious- 
Perron operator Pf by a matrix D of size iV + 1 X N + 1, the elements of which read, 

Aim = / u n (f(x))v m (x)dx, n,m = 0, . . . ,iV. (27) 



.7 

Although the probability is conserved under the action of Pf, the matrix D need not be 
stochastic. This is due to the fact that the functions {v m (x)} forming the expansion basis 
in (121} were not normalized. We shall then compute their norms, 

T m = v m (y)dy = ^2A mn b n (28) 

J n=0 

where, 

b n = [ v n {y)dy. (29) 

Let K < N + 1 denote the number of non-zero components of the vector r and let k = 
1, . . . , K runs over all indexes n G 0, . . . N + 1, for which 77. 7^ 0. Then the rescaled vectors, 

V k (y) :=v k (y)/r k , (30) 

are normalized, 

V k (y)dy=l. (31) 
The normalization condition p(x)dx = 1 implies 

X N N K 

j ^ <llV m (x)dx = ^2 <lrnTm = ^ qkU = 1 (32) 
^° m=0 m=0 k=l 

The same is true for the transformed density, 

k 

Hence this scalar product is preserved during the time evolution. Making use of the rescaled 
coefficients 

Cfc := qkT k , (34) 
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FIG. 1: The cosine noise of Eq. (|37jl closely resembles a normal noise profile, but with finite support. 
Several values of N are shown, with decreasing standard deviation with increasing N. 

the dynamics (}26|) reads 

4 = 1k T k = Yl Dk i q i Tk = D V ~ q i T i =: S Tk i °i- ^ 

Tj 

3 3 3 

The coefficients Ck sum to unity, so the transition matrix 

T kj = D kj J = D k3 X~ ■ (36) 

is stochastic. In the above equation, all indices run from 1 to K and the coefficients 
are non-zero by construction. Hence the dynamics (J26|) effectively takes place in an K- 
dimensional Hilbert space, and the Frobenious-Perron operator Pf is represented by a 
stochastic matrix T is of size K x K. The dimensionality K < N + 1 is determined by 
the parameter N and the choice of the basis functions {vi(x)} entering ([20)1 . 



V. A SPECIAL CASE: COSINE NOISE 



We will now discuss a particularly simple case of the separable noise described above, 
introduced in [l2|. Let, 

V N (0 = ^cos N (nO, (37) 
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where N is even (N = 0,2,...) and with the normalization constant, 

r[iv/2 + i] 

CN = v ^r[(iv + i)/2] • (38) 

See Fig. ^ in which we can see the decreasing standard deviation with respect to increasing 
N, and it can be seen that this type of noise reminds of a normal distribution, but of compact 
support. 

The parameter N controls the strength of the noise measured by its variance 

N/1 



1 „N , 1 1 1 

=sV(- + l) = --^-£-,, ( 39 ) 



a 2 

2n 2 ~ " 2 ' 12 2vr 2 ^ m 2 

m=l 



where stands for the derivative of the digamma function. 
For the expansion (j^UJ) we use basis functions, 



u m (x) = cos m (7rx) sin^ m (vrx), 



v n (y) = cos n (7ry)sm N - n (ny), (40) 

where x G X and m,n = 0, . . . , N. Expanding cosine as a sum to the iV-th power in (}37|) 
we find that the (N + 1) x (TV + 1) matrix A defined by (|2()jl is diagonal, 

A m n = a m S mn , with a m = C N ■ (41) 



Integrating trigonometric functions we find the coefficients, 

1 • m , \ iv mi x, 2 r[(m + l)/2]r[(jV-m + l)/2] 

im m (7rx) cos N - m (TTx)dx = ;/ 1 , , ^ , (42) 

K J K ' vriV r(JV/2) V ; 

and, 

which are non-zero only for even values of m. Hence the size K x K of the transition matrix 
reads, 

K = N/2 + 1, (44) 
and the expression (jHfij) takes the form 

T fci = £W^^ where k,j = l,...,K; m = 2(k-l), n = 2(j - 1) . (45) 

We find in the cosine noise Eq. ([37)1 and with basis Eqs. ()40j) . that the transition kernel 
reminds of a fuzzy but periodically repeated version of the map. See Fig. |21 However, the 
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Frobenius-Perron operator embeds to a transition matrix T, which "appears" roughly as a 
different form of the original map. See Fig. EJ However, with zero-noise, an Ulam transition 
matrix approximating the Frobenius-Perron operator would appear as the deterministic map. 
For this reason, we define the limit of T matrices as K — > oo to be a singular limit of the 
Frobenius Perron operators, and associated the associated transformations. 

There is an interesting correspondence between the spectrum of eigenvalues of the two 
matrices D and T. Since T is stochastic its largest eigenvalue is equal to unity. Moreover, it 
is the only eigenvalue with modulus one, which follows from the fact that the kernel V(x, y) 
vanish only for x — y = 1/2 (mod 1), and the two-step probability function is everywhere 
positive, 

J V{x, z)V(z, y)dy > 0, for x, y E X. (46) 

See 0|, Th. 5.7.4. A particularly useful consequence and simplification is that the eigenstate 
corresponding to the largest eigenvalue of the matrix represents the invariant density of the 
system, p* = Pf(p^); this can be easily found numerically by diagonalizing T. 

All of the other eigenvalues are included inside the unit circle and their moduli |Aj| 
characterize the decay rates. It is worth emphasizing that the spectra of both matrix repre- 
sentations of the FP-operator - by matrices D of size (N + l) X (N+l) used in Q,Q,Q 



and the stochastic T matrices of size (N/2 + 1) x (N/2 + 1), developed here, coincide up to 
the additional N/2 eigenvalues which are equal to zero - see the Appendix for details. 
For concreteness let us discuss an exemplary 1-D dynamical system, a tent map: 



fix) :-. 



2x if 0<x<l/2 

2(1 -x) if 1/2<x<1. 



(47) 



Simple integration allows us to obtain analytic form of the transition matrix TW for the 
tent map (|37|) perturbed by additive noise characterized by small values of N, 



T (2) 



1 1 
1 1 



T (4) 



1 

24 



11 3 11 

6 6 6 

7 15 7 



T (6) 



320 



145 25 25 145 

69 45 45 69 

51 75 75 51 

55 175 175 55 



(48) 



In the simplest case N = 2 the transition matrix is bistochastic, but it is not so for larger 
N. However, for this system, the matrix T^' is of rank one for arbitrary value of the noise 
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FIG. 2: The transition kernel VN(f( x ),y) f° r the logistic map f{x) = 4x(l — x), with N = 20 and 
with cosine noise due to N = 20; compare to Fig. ^ Note the periodicity of x of period-1. 



parameter N. The spectrum of T contains one eigenvalue equal to unity and all others 
equal to zero. This implies that every initial density is projected onto an invariant density 
already after the first iteration of the map. This is not the case for other dynamical systems 
/ including the logistic map f r (x) = rx(l — x), for which the spectrum contains several 
resonances - eig envalues of moduli smaller than one, which describe the decaying modes of 



the system 
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VI. APPROXIMATION BY BASIS MARKOV MAPS 

While not all maps and noise profiles allow for the map to be basis Markov, in this section 
we will show that a non basis Markov map may be weakly well approximated by basis Markov 
maps. In this sense, the finite approximations offered by basis Markov maps can be thought 
of as a good description of the general behavior, since the invariant measures of the finite 
approximations due to the basis Markov maps have weak-* limits to the invariant measures 
of the general maps. 
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o o 



FIG. 3: The stochastic matrix T150 shown, from Eq. (|36j) . exactly represents the stochastic 
Frobenius- Perron operator of the stochastic tent map Eq. (|47|) with trig noise Eq. I|37j) . and basis 
set Eq. (001), using N = 150. Note that T^ 150 ) is a matrix of size N/2 + 1 = 150/2 + 1 = 76 square. 
Compare to the matrices in Eq. (|48|) . of smaller N. 

Considering the transition probabilities in Eqs. (fT9"j) - (}2"U)) . we now write Vn(x, y) to denote 
the subindex N to describe the finite number of terms sufficient to describe the probability 
in assumption (J20|) c. We require the following assumptions about the transition probabilities 
V N {;-): 

1- ^Pn(', ") is measurable function of two variables; 

2. For every x we have, J Vn(x, y)dy = 1. 

3. For every y G X we have 

Vn(x, y)dx = 1. 



4. Let B(x,r) = {y : \x — y\ < r} and, 



p N (x,r) 



V N (x,y)dy. 



(49) 



X\B(x,r) 
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Then, for any r > 0, 

Pjv(^) = suppAr(x, r) — > 0, as iV ^ +oo. 

Assumptions 1-3 are typical for probability measures, while assumption 4 is also rather 
mild, and it is easy to check that all four assumptions are satisfied by the cosine noise 
Eq. (EH). 

Under these assumptions, the following is true: 
Proposition: For any p E L X (X) we have 

p(x)VN(x,y)dx — > p(y), as iV — > oo (50) 

in L\X). 

Proof: Let us assume that p is uniformly continuous and let us fix an e > 0. We can find 
an r > such that \p(x) — p(y)\ < e whenever \x — y\ < r. We have 

fx \P(V) ~ I x P( x ) V N(x,y)dx\dy = 
(assumption (3)) = J x \ J x p(y)VN(x, y)dx — J x p(x)Vn(x, y)dx\dy 

^ Ix Ix \p(v) ~ p(x)\V N (x,y)dxdy 

= I S{(x,y):\x- y \<r} \p(v) ~ p(x)\V N (x , V )dxdy 

+ / !{(,x,y):\x- y \>r} \p(y) ~ p(x)\V N (x, y)dxdy 



X 



<e-l + 2-(max x \p\)-p N (r). (51) 

The last estimate can be made arbitrarily small in view of assumption (4). 

Once the convergence is proven for uniformly continuous functions, the proof of conver- 
gence for general L l (X) functions is standard: 

Since the natural norm of the operator Pp N (p)(y) = J x p(x)Vn{x, y)dx in L^i^X) is 1, we 
have 

Wp-PvMW < Hp -Pell + \\p c - Pv N {pc)\\ + \\PpM-PpMW 
< Hp- p c |l + Wpc- Pv n {pc) II + H^PivllllPc - pII 

<2\\ P - Pc \\ + \\p c -P Vlt {p c )l (52) 
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where p c is a uniformly continuous approximation of p. □ 

We will say that the transformation / : [0, 1] — > [0, 1] preserves continuity iff for any 
continuous function p the composition p o / is also continuous. Obviously any continuous 
transformation / preserves continuity. There are discontinuous maps which also preserve 
continuity, e.g., f(x) = kx — Int(kx), for integer k > 2. We now confirm the following result, 
stated in the language of our current problem, 

Theorem: 1. Let the transformation / be continuity preserving. Under the assumptions 
(1), (2), and (4), it follows that if p^ is an invariant measure of the stochastic perturbation 
of transformation / defined by the transition probability Vn, then every weak-* limit point 
of the set {p^ '■ N > 1} is an /-invariant measure. 

Proof: This theorem can be proved following the ideas from, R.Z. Khasminskii, jlij. Let 
us assume that p^ — > p weakly as iV — > +oo. We want to show that p is /-invariant. To 
this end it is enough to show that 



pdp= / p(f)dp, 
Jx 



for any continuous function p. The stochastic perturbation of / defined by transition prob- 
ability Vn acts on continuos functions as a compositions with / followed by application of 
the operator P*v N , defined as follows 

( p *v N p)(x)= I p(y)V N (x,y)dy. 
Jx 

This operator is conjugated to the operator Pp N defined in the proof of the previous theorem. 
P*v N acts on functions, while P-p N acts on functions understood as densities. Thus, 

J^pdp N = J P* N (p(f))dp N , 

for any continuous function p. Using assumption (4) we obtain 

\p(x) - (P^ N p)(x)\ 
= I Ix p(x)V N (x, y)dy - J x p(y)V N (x } y)dy\ 

^ f{y.\ y -x\<r} \p( x ) ~ P&) \ v n(x, y)dy + f {y:ly _ x] > r} |pO) - p(y) \V N (x, y)dy 

<e + 2- (max x \p\) -p N {r), 

where e and r are as in the proof of the previous theorem. This shows that P£ N (p) converges 
uniformly to p for any continuous function p as iV — » +oo. 
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We have 

I fx P d P ~ Ix PU)M < I fx P d P ~ Ix P d ^\ 
+ 1 JxPdfiN ~ I Pv n W)Wn\ + \JPv n W)Wn - SxPWM 
+ 1 Ix p(f) d PN - Jx p{fW\ 

The first and the last differences converge to since px converge *-weakly to p. The second 
difference is by the definition of fix- The third difference converges to by the uniform 
convergence established just before. This proves Theorem 1. □ 

In this way we have established a relation between a sequence of noisy systems fx and 
the deterministic dynamical system /. A stochastic system (j!8)l with the noise profile (jHTjl 
for a fixed noise parameter N is described by a stochastic matrix of size K = N/2 + 1 
and acts in the Hilbert space Tlx- 

We have shown that the sequence of stochastic matrices T^ N \ corresponds to the dynam- 
ical system /, in a sense that the sequence fix of the invariant measures of converge 
weakly to the /-invariant measure p in the deterministic limit N —>■ oo. Furthermore, for 
any initial density p the sequence of vectors p' N transformed by fx converges weakly to the 
density transformed by the Frobenious-Perron operator associated with /. Observe that 
the above property holds not only for one- dimensional systems, but also dynamical system 
/ in higher dimensional measure spaces. 

VII. CONCLUDING REMARKS 

In this work we have introduced the concept of basis-Markov stochastic systems, for 
which the associated Frobenius-Perron operator is finite. This property resembles the class 
of deterministic systems with a Markov partition. However, the Markov partition is char- 
acteristic to a very special class of deterministic systems, while the basis-Markov property 
is related to the kind of stochastic perturbation. It holds for any deterministic system /, 
subjected to an additive noise with a profile satisfying the separability condition f|2()(l . In 
this way such a random dynamical system can be described by a stochastic transition matrix 
of a finite size K, which diverges in the deterministic limit. 

We have shown an intimate relationship between the sequence of stochastic matrices 
which act in the space of A'-point probability distributions and the FP operator Pf of 
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the deterministic system, which acts in the infinite dimensional space: In the deterministic 
limit K —>■ oo the invariant densities of stochastic matrices converge in a weak sense to the 
invariant measure of the deterministic system /. Thus constructing the transition matrices T 
and decreasing the noise strength (and increasing the dimensionality K) one may construct 
arbitrary approximations of the FP operator Pf. 

Note that the described method of finding an approximate invariant density of a de- 
terministic system by applying a weak noise is not restricted to one dimensional systems. 
On the contrary, the entire construction can be directly applied for a general case of multi- 
dimensional dynamical systems. In particular, the definition (j^Ojl c of separable noise profiles 
works for the case of an L-dimensional systems, provided the variables x and y represent 
vectors with L components each. 

If the dynamical system acts on the L-torus for example, M = [0, 1] L , one can take the 
Cartesian product of the cosine noise (|3*7j) setting 

Mi,- U) = C L N cos^KO cos"« 2 ) ■ • cos^Kl) , (53) 

where = Xk — Uk and k = 1, . . . , L. This form of the additive noise was used in to 
analyze a 2-dimensional system (a variant of the baker map), and to compare the spectral 
properties of the FP operator associated with the classical stochastic system with properties 
of the propagator of the corresponding quantum evolution. In such a case the deterministic 
limit of the classical noisy system, K — > oo is related to the classical limit, h — * 0, of the 
corresponding quantum dynamics. 

Note that for basis-Markov stochastic systems, the transition matrices T exactly describe 
the action of the dynamical system with additive noise on densities. Thus our construction 
differs from an approach applied in [l^, 13, 13], were a finite dimensional description of 
the density dynamics of a deterministic system was achieved by truncation of an infinite 
transition operator Pf to the finite dimension K. The effect of such a truncation may also 
be regarded as a kind of noise depending on the matrix size K and the base, in which Pf 
is represented. On the other hand, in our case a suitable choice of the noise profile added 
to the deterministic system distinguishes a relevant basis, in which the FP operator of the 
perturbed system is finite. 
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IX. APPENDIX: ISOSPECTRAL MATRICES 

In this appendix we show that the matrix D defined by Eq. (|2*7jl and used in Q Q 
to represent the Frobenius-Perron operator and the stochastic transition matrix T share the 
same non-zero part of the spectrum. We make use of a following algebraic result, 

Lemma. Let A be a square matrix of size N x N and s a vector of length N containing 
only non-zero entries. Then the matrix 

B jk = A jk ^, (54) 

has the same spectrum as A. 

(there is no summation over repeating indices). 

Proof: To study equation det(B — Al) = we start analyzing an exemplary term P B 
of the determinant. It consists of a product of N elements where o~(i) stands for a 

certain permutation of the indeces. The product of N factors of the type Si/s^us is equal to 
unity, so that 

p? = n = n sis2 "' sn = n ^» • ^ 

- LJ - - LJ - SiSo---S N - LJ - 

ii i 

Thus every term contributing to the free coefficient of the characteristic equation will be the 
same, P B = P A , hence these coefficients for both matrices A and B are equal. Since the 
diagonal elements of both matrices coincide, Bjj = Ajj, all terms forming the coefficients 
standing by an arbitrary power of A are the same for both matrices. Therefore characteristic 
equations for both matrices are equal and so are their spectra. □. 

Treating all non-zero elements of the vector t&, k = 1, . . . , K as vector s we may apply 
the lemma to equation and obtain equivalence of the spectrum of T and the non-zero 
part of the spectrum of D. Since integrals (f23j) vanish for odd values of m, every second 
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column of D is equal to zero, and the remaining N/2 eigenvalues of D are equal zero. 
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